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Abstract 

We consider the problem of maximizing the algebraic connectivity of the communication graph in a network of mobile robots by 
moving them into appropriate positions. We define the Laplacian of the graph as dependent on the pairwise distance between 
the robots and we approximate the problem as a sequence of Semi-Definite Programs (SDP). We propose a distributed solution 
consisting of local SDP's which use information only from nearby neighboring robots. We show that the resulting distributed 
optimization framework leads to feasible subproblems and through its repeated execution, the algebraic connectivity increases 
monotonically. Moreover, we describe how to adjust the communication load of the robots based on locally computable 
measures. Numerical simulations show the performance of the algorithm with respect to the centralized solution. 

Key words: Distributed Control of Robotic Networks, Connectivity Maximization, State-dependent Graph Laplacian, 
Collaborative systems, Networked robotics 



1 Introduction 

Teams of autonomous mobile robots that communicate 
with one another to achieve a common goal are consid- 
ered in several applications ranging from underwater and 
space exploration [12, 17], to search and rescue [6, 16], 
monitoring and surveillance [5, 18]. These robots pos- 
sess on-board processing capability, but the common 
task can only be achieved through information exchange 
among the members and possibly a base station. Such 
multi-robot teams are thus often referred to as robotic 
networks. Among the engineering and research questions 
these applications pose, maintaining connectivity be- 
tween the individual robots and increasing the communi- 
cation quality under given constraints, have fundamen- 
tal importance. Several types of coordination and con- 
trol frameworks that have been recently proposed rely 
on agreement protocols or consensus processes that lead 
to coordinated team actions [4,13,21]. Since these proto- 
cols typically assume only local communication among 
"neighboring" robots, the interconnection topology of 
the underlying communication graph influences greatly 
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their effectiveness. In particular, their convergence prop- 
erties are dictated by the algebraic connectivity of the 
communication graph [19]. 

In this paper, we study distributed solutions for maxi- 
mizing the algebraic connectivity of the communication 
graph (often denoted as A2) in mobile robotic networks. 
We note that, besides the benefit in terms of improved 
communication, the tools that we develop are instrumen- 
tal for handling cases where network of mobile robots 
have other common tasks, in addition to the requirement 
to increase their A2 • Examples of scenarios where our so- 
lution could, or has been used in a preliminary version, 
are collaborative multi-target tracking [11,23] and coor- 
dination control [10]. For example, in [11], the authors 
specifically increase the A2 of a special weighted graph 
that describes the visual connection with multiple tar- 
gets. Their aim is to move a group of mobile robots in 
order to increase the visibility of multiple targets. In this 
context, the problem of A2 maximization could also be 
seen as an alternative formulation of the optimal sensing 
placement problem in a dynamic environment [11]. 

References [7, 22, 25-27, 29] give a comprehensive 
overview of distributed algorithms for robotic networks 
that aim at ensuring connectivity (i.e., nonzero A2 rather 
than its maximization). Typically, these algorithms are 
either limited to specific scenarios only, or imply heavy 
communication requirements, and often they are not di- 
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rectly related to the solution of the centralized version. 
In terms of distributed connectivity maximization, the 
available literature appears to be very limited. To the 
best of our knowledge, only the work in [9] investigates a 
distributed solution for the maximization of A2 based on 
a simplified scenario where the dynamics of the robots 
are represented by a single integrator and no constraints 
are present. The authors use a two-step distributed al- 
gorithm, which relies on super-gradients and potential 
functions. The required communication load scales with 
the square of the graph diameter which may impede fast 
real-time implementations for large groups of robots. 

We consider as starting point the centralized optimiza- 
tion procedure of [3 , 1 1 , 14] . In these works the maximiza- 
tion of the algebraic connectivity is approximated as a 
sequence of Semi-Definite Programs based on the notion 
of state-dependent graph Laplacian, while the agents are 
modeled as discrete-time single integrators. 

Our first contribution is to modify the aforementioned 
centralized optimization procedure in order to handle 
more generic LTI robot dynamics. The resulting opti- 
mization problem is then proven to be feasible at each 
time step under quite general assumptions. 

As our second contribution, we propose a distributed 
solution for the centralized problem (Algorithm 1) sub- 
stantially extending our preliminary results in [24] . Our 
proposed distributed approach relies on local problems 
that are solved by each robot using information only 
from nearby neighbors and, in contrast with [9], it does 
not require any iterative schemes, making it more suit- 
able for real-time applications. This last property is not a 
trivial aspect when using common decomposition meth- 
ods for optimization [1], as done in various approaches 
to distributed control [15,20]. In our approach (i) we 
formulate local problems of small size that are clearly 
related to the centralized one, (ii) the linearized alge- 
braic connectivity of the approximate problem is guar- 
anteed to be monotonically increasing, (Hi) the overall 
optimization scheme is proven to be feasible at each time 
step under quite general assumptions, and in particular 
(iv) the local solutions are feasible with respect to the 
constraints of the original centralized problem. 

Finally, we characterize the local relative sub-optimality 
of the optimized A2 with respect to a larger neighbor- 
hood size and we use this characterization to enable 
each robot to increase or decrease its communication 
load on-line, while respecting the properties (ii) - (iv). 
This means that our solution can be adapted based on 
available resources, augmenting or reducing the required 
communication and computational effort. 

The proposed distributed solutions can be seen as a 
complementary approach to standard subgradient algo- 
rithms [1] . Distributed versions of incremental subgradi- 
ent algorithms are typically communication intensive it- 



erative algorithms, in which at each iteration, each agent 
has to evaluate only a local subgradient of a certain 
function. Our proposed solutions lie on the other side of 
the "communication-computation" trade-off spectrum. 
In fact, each robot solves a reasonably complex convex 
optimization problem, while the communication among 
them remains limited. In this context, multi-robot sys- 
tems embedded with reasonable processing capabilities, 
where real-time applicability is a strong requirement, 
could benefit more from our proposed approach than 
from standard subgradient algorithms. 

The paper is organized as follows. Sections 2-3 for- 
mulate the approximate centralized problem based 
on [14]. Starting from a general time-invariant non- 
convex formulation (6), first we discuss the sequential 
Semi-Definite Programming approach (13) considering 
single integrator dynamics for the agents (1), as done 
in the literature [11, 14]. Second, in Section 4 we extend 
this sequential Semi-Definite Programming approach to 
more general LTI agent dynamics (14) in problem (22). 
The proposed distributed approach for problem (22) is 
described in Section 5 in problem (25) and Algorithm 1. 
Its properties are analyzed in Section 6, while the local 
relative sub-optimality measures are the topic of Sec- 
tion 7. Numerical simulations are shown in Section 8 
to assess the performance of the distributed solutions. 
Conclusions and open issues are discussed in Section 9. 

2 Problem Formulation 

The notation is standard: for any real scalar s, s e Mo 
if s ^ 0, s e K+ if s > 0, and s e M+ if s > 0. The 
matrices /„ and 0„ represent the identity and the null 
matrix with dimension n x n, respectively. The column 
vectors 1„ and 0„ define vectors of dimension n where 
all the entries are 1 and 0, respectively. 

Consider a network of N agents with communication and 
computation capabilities and express as a^(fc) the value 
of the variable a for agent i at the discrete time instant k. 
The position of agent i is denoted by Xi (k) € R 3 and its 
velocity by Vi(k) G R 3 . In order to introduce the works 
of [3, 11, 14], we assume the agents to move according to 
the following discrete-time dynamical system: 

Xi(k + l)=Xi(k)+Vi(k)T s (1) 

where T s is the sampling time. This single-integrator 
model will be extended in subsequent sections. 

Graph-theoretic notions are used to model the network. 
Let x(k) be the stacked vector containing the positions 
of the agents, i.e. x(k) = (xj(k), . . . ,xJj(k)) T . The set 
V contains the indices of the mobile agents (nodes), 
with cardinality N = |V|. The set £ indicates the set of 
communication links. The graph Q is then expressed as 
Q = (V,£) and it is assumed undirected. Let the agent 
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Fig. 1. Weighting function f w {) for modeling connectivity 
between two agents i,j. If d 2 j(k) < pi then Wij = 1, while if 
dij(k) > p2 then = 0. 

clocks be synchronized, and assume perfect communica- 
tion (no delays or packet losses) . The agents with which 
agent i communicates are called neighbors and are con- 
tained in the set A/",. Note that agent i is not included in 
the set Mi. We define =A/jU {i} and N t = \M z +\. 
Dchnc the Laplacian matrix L associated with Q via its 
entries £ij as £%j{k) = for £, hj{k) = —Wij(k) 

for e £, and £ij(k) = J2i^i w u( k ) for i = 3- Tne 

weights < Wij < 1 are assumed to depend on the 
squared Euclidean distance of Xi(k) and Xj(k) defined as 



and 



4(fe) = f d (xi(k), Xj (k)) = \\ Xi (k) -x 3 (k)\\ 2 (2) 



w^k) = f w (\\ Xi (k) - Xj (k)\\ 2 ) (3) 



where f w : R + — > [0, 1] is a smooth nonlinear function 
with compact support. The weights model the connec- 
tion strength between two agents. The closer two agents 
are, the closer to one is the weight, representing an in- 
crease in the communication "quality" . For simulation 
purposes we use the function qualitatively represented 
in Figure 1, which is one when the squared distance is 
less than p\ and it is zero when the squared distance is 
greater than p 2 . For a detailed discussion on the choice 
of /„, the reader is referred to [14]. As a direct conse- 
quence of the above definitions, the entries of the Lapla- 
cian matrix L depend on the state of the agents, making 
it state-dependent, which we will denote by L(x(k)). 

We are interested in maximizing the algebraic connec- 
tivity of the weighted graph by controlling the state of 
the agents, i.e., moving them to appropriate positions. 
First of all, we notice that [3] 

maxA 2 (a;) = {max7|s.t. L(x) + In In ^ 



which can be proven formally as follows. 

Proposition 1 For any two scalars A > A 2 > 0, the 
constraint 

X 2 (L) > A 2 , (4) 
can be formulated with the equivalent Matrix Inequality 



Proof. By construction, the Laplacian matrix L has as 
eigenvector ei — In- All the other eigenvectors, e*, are 
orthogonal to ljv, meaning l^e, = 0, for i = 2, . . . , N. 
This implies that 

(L + (X/N)1 N 1 N ) = Le, = A,e,, for i = 2, . . . , N 

and therefore L + (X/N)1n1 n ^ as the same eigenval- 
ues/eigenvectors of L for i = 2, . . . , N. The remaining 
eigenvalue is associated with the ei eigenvector: 



(L + (X/N)l N ll) ei = L1 N + (A)ljv = Al 



N 



and its value is A. As a result, the eigenvalues of L + 
(\/N)l N l N are 

X,X 2 (L),X 3 (L),...,X N (L). 

Since we have already that A > A 2 (by assumption) , and 
A 2 (£) < Xs(L)_ < . . . Xn(L), the constraint (5) imposes 
that A 2 (L) > A 2 and thus it is equivalent to (4). □ 

Since for the specified weighted Laplacian L{x) the max- 
imum value for A 2 is N — 1 [8] , we can chose A = N in (5) 
and write the maximization of A 2 as 



P (L(x),pi) : max 7 

x,7 



(6) 



s.t. 7 > 

L(x) + InIn y iIn 
f d {xi,Xj) > pi, V(i,j')e£ 

The optimal decision variables are the final robot loca- 
tions x and the optimal value of 7 which is the maximum 
A 2 for L(x). The constraint on fd(xi,Xj) prevents the 
agents from getting too close to each other and ensures 
that the trivial solution in which all the agents converge 
to one point is not part of the feasible solution set of (6). 

3 Centralized Solution 

Problem (6) is non-convex [14] but it is rather standard 
to obtain a time- varying convex approximation by using 
first-order Taylor expansions, [11, 14]. Define 



dfw ddij 



" 13 dd?j dxi 



df w dd^ 



Xi(k),Xj (k) 



dfd 

dxi 



Xi (k),Xj (fc) 



dfd 
dxj 



dd% dx-j 



Xi (k) ,xj (k) 



xi(k),Xj (k) 



(7) 



(8) 



then 



L + (X/N)1 N 1 N ^ A 2 Jjv. 



(5) 



Wij (k + 1) = w tj (k) + c™ T (Sx t (k + 1) - Sx 3 (k + 1)) (9) 
4(fe + 1) = d%{k) + [ij] T {5xi(k + 1) - S Xj (k + 1)) (10) 
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where 5 represents the difference operator, i.e. Sxi(k + 
1) = Xi(k+1) — Xi(k). The symbol A will be employed to 
define the linearized entities; hence the entry A.£ij (x(k + 
1)) of the Laplacian AL(x(k + 1)) will be 



A^(x(fc+1)) = 



(11) 



{i,j)££ 
-Wijik) - c% T {6xi{k + 1) - 8 Xj (k + 1)) e£,i^j 
T,i^iWu(k + l) i = j 



while 



Af d (xi(k+l),x 3 {k+l)) = dl(k)+[ij] T (8x l {k+l)-Sx :i (k+l)) 

(12) 

This allows us to consider the maximization of the al- 
gebraic connectivity of L as the following time- varying 
convex optimization problem [11, 14]: 



AP {L(x(k)),x(k),S AQ . 
s.t. 

7(fc+l)>0 



max 7(fc + 1) (13) 

x(fe+l), 7 (fc+l) 



AQ 2 : { 



AL(x(k + 1)) + l N lJ, y 7 (fc + 1)7jv 

Qa.i : Af d (xi(k + l),Xj(k + l))>pi, 
V(»,j) e£ 

Q2.2 : ||x»(fc + 1) — I < ^max J- s 

i = 1 JV 



where <Saq 2 = {pi,Wmax} represents the parameter set 
that characterizes the set of constraints AQ2, and it is 
used to highlight the dependence of the problem on the 
"physical" limitation of the application scenario (i.e., 
in this case, the mutual distance pi and the maximum 
allowed velocity v max ). 

In contrast to the original non-convex problem (6), the 
optimization problem (13) is solved repeatedly at each 
discrete time step k on-line. In this sense (13) is the 
fc-th problem of a sequence of convex SDP problems. 
Note that the achieved maximal algebraic connectivity 
7 depends on k and thus we use j(k), while the itera- 
tive scheme for updating 7 is the repeated solution of 
the optimization problem itself. This means that, letting 
AP(x(fc)) represent problem (13), 7 evolves as 

(x(k + 1), 7(fc + 1)) = argmin AP(x(fc)). 

As a consequence of using this sequential convex pro- 
gramming approach (and as a consequence of the non- 
convex nature of the original problem) , although we aim 
at increasing the cost function at each step k, we might 
converge to a local minimum of the original problem (6) 
and a strong dependence on the initial configuration of 
the agents has to be expected. Despite these drawbacks, 



it has been shown [14] that this formulation does in- 
deed lead to satisfactory local optimal final configura- 
tions with a clear increase in the algebraic connectivity. 

Assuming that the initial positions x(0) form a con- 
nected graph and the mutual distance between the 
agents is greater than y/pi, i.e., assuming initial fea- 
sibility for the problem, we can prove that the opti- 
mization problems (13) will remain feasible for all the 
subsequent time steps k > (in fact one can always 
select x(k) — x(k + 1) to obtain a feasible solution) 
and their solution sequence monotonically increases the 
algebraic connectivity, [14]. The property of remaining 
feasible for all k is related to persistent feasibility (also 
known as recursive feasibility), which is a well-known 
and fundamental concept in the optimization-based 
control literature [2]. In particular, persistent feasibility 
ensures that, for any k, if the fc-th convex problem (13) 
is feasible then the (fc + l)-st problem will be feasible. 
This, in addition to initial feasibility (i.e., feasibility 
at fc = 0), guarantees that the overall sequential opti- 
mization scheme is feasible for all k > 0. It has to be 
noted that persistent feasibility ensures only that the 
solution set of each problem (13) is non-empty, while 
any improvement in the cost function should be proven 
separately. However, persistent feasibility is needed to 
justify the overall optimization scheme in practice. 



4 More general LTI dynamical models 

As our first contribution, we extend the problem (13) in 
order to allow a more general LTI dynamical model for 
the agents. Let Xi(r) = (xi(r) T , Ui(r) T ) T be the state of 
agent i at the discrete time r. We note that the sampling 
periods belonging to r and fc may differ, meaning that 
the optimization (13) could be run at a slower rate than 
the system dynamics. Let the agents have the following 
second order discrete-time LTI dynamics: 

^«i(T+l) J \0 3 A 2i j \vi{r) j \buh j 

(14) 

where An e K 3x3 , A 2i e M. 3x3 ,b u e Eo,andui(r) e K 3 
is the control input. Assume: 

Assumption 1 The matrix An is full rank Vz. 

Assumption 2 The control input for each agent at each 
discrete time step is constrained in the closed polytopic 
setUii 

Ui{r) € Hi, U l = {u % (j) e M. 3 \H iU i(T) < hi}, 3 G Ui (15) 

described via the matrix Hi and the vector hi. 

Assumption 1 is meant to ensure the one-step control- 
lability of the dynamical system described in Eq. (16). 
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Analogously to t> max in problem (13), Assumption 2 lim- 
its the control input to account for the physical limi- 
tations of the agents, and it is a standard formulation 
of actuator limitations in the optimization-based con- 
trol community. The state space system in (14) can 
model agents for which the acceleration does not de- 
pend on the position and for which zero velocity and 
acceleration input (u,(r) = and Uj(r) = 0) implies 
Xi(r + 1) = Xi(r). Typically, this class of systems can 
represent different types of physical agents ranging from 
fully actuated mobile robots to underwater vehicles. The 
choice A\i = IsT s , A 2 i = h, bu = T s yields a dou- 
ble integrator with sampling period T s . The reason for 
the choice of (14) is to consider the simplest model that 
is capable of showing how to handle the main difficul- 
ties when extending the optimization problem (13) to 
general LTI models. In particular, the key issues arc 
persistent feasibility and collision avoidance. To guar- 
antee persistent feasibility we show how to ensure that 
x,(fc + 1) = (xj (k),0j) T is a feasible state for all the 
agents recalling that the feasibility of the similar solu- 
tion Xi(k + 1) = x.i{k) is a sufficient condition for (13) 
to be persistently feasible. The collision avoidance is- 
sue is generated from the fact that the constraint on 
fd{xi(k) 7 Xj(k)) is enforced only at each time step k, 
when the optimization problem is solved, but not for ev- 
ery r, which might be a higher rate implementation of 
the dynamical model. In this respect we show how to en- 
sure that fd(xi(r), Xj(r)) > for every r. We will show 
that when persistent feasibility and collision avoidance 
are handled correctly, the problem (13) can be extended 
to dynamical models of the form (14). In Appendix A 
we discuss how to possibly cope with these two aspects 
for an even broader class of LTI dynamical systems. 

Remark 1 The results of this papers apply to agents 
modeled via specific LTI dynamical systems. However, 
the paths ( or waypoints ) generated for these LTI agents 
could still be followed by differential drive/tracked vehi- 
cles, which see widespread use in mobile robotics. Addi- 
tional examples include the works of M. M. Zavlanos and 
co-authors (e.g., [28]) where the discrete-time optimiza- 
tion is used by a continuous-time robot (whose dynamics 
can be rather arbitrary) in a hybrid systems fashion. 



4-1 Persistent Feasibility 



The first step to guarantee persistent feasibility is to 
ensure that at each time step k we can affect the position 
of the agents via the control input. This is not trivial 
because the position Xi(r + 1) cannot be controlled in 
one step by Ui(r). However, we can overcome this issue 
by solving the optimization problem at a slower rate 
than the implementation of the control input, e.g., once 
in two time steps r when we determine both Ui(r) and 
Ui(r + 1). In this case the dynamical system (14) can be 
lifted as seen by the optimization problem: 



Xi{r + 2) 

Vi(T + 2) 



h A u (h + A 



3 Ali 



( buA u 


°" ( 


\ buA2i 


huh / \ 




we let k — t/2, and for integer fc's, we define the lifted 
variables xf (k) — Xi(r), v\ (k) — «i(r), the lifted state 
xf(fc) = (xf(k) T ,vf(k) T ) T , and the lifted control input 
uf(fc) = (ui(r) T , u i (r+l) T ) T . Forthesakeof simplicity, 
from now on, we will omit the superscript L with the 
idea that if we use the index k we are referring to the 
lifted variables. With this in mind, we can rewrite the 
system (16) using the short-hand notation 



Xj(fc + 1) =X\(x i (fc),u i (fc)) 



(17) 



We note that the lifted system (17) is controllable to an 
arbitrary state in one step from k to k + 1 (see Remark 2 
for details). However, the input is constrained to lie in 
Ui(fc) e Ui (Assumption 2), where Ui — Ui xWj, i.e.: 



U % = ju, 



(k)e 



Hi 



Hi 




u, (/■•) < J | , o 6 e Ui 

(18) 

Therefore, the next step is to find a feasible control 
input value Ui(k) £ Ui for which T>i(xi(k), u^(fc)) = 
(xi(k) T , 0j) T . For this reason define the set Ti as 



Xi(fc) e Ti 3uj(fc) £ Ui such that 

) 3 T 



T>i(xi(k), Uj(fc)) = (x 4 (fc) T , 0j) T , Vfc e N+ (19) 



For the system (16) the set Ti can be computed as the 
Cartesian product of T Xy i and T v ^, i.e., T = T x ^ x T v s, 
where: 

F x ,i = {xi(k) e M 3 } , and 



Vi(k) e 



H,b- i 1 A 2l (h + 2A 2l ) \hi 



(20) 



We note that (x 4 (fc) T , 0j) T e T t . 
4-2 Collision Avoidance 

In order to ensure no collisions, a lower bound on 
pi has to be determined, which guarantees that if 
fd(xi(k),xj(k)) > pi and f d (xi(k + l),Xj(k + 1)) > pi, 
then fd(xi(T + 1),xj(t + 1)) > 0, for every k and r. 
The collision-free condition for any couple i and j can 
be written as 
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Remark 2 The dynamical system (16), which is the agent representation seen by the optimization problem, can be 
written as 

*(* + !)-(* A '^ + A *A M k) + ( b " Al ' 03 W> < R1 > 

This system is controllable in one-step by an unconstrained Ui(fc). In fact, given an arbitrary state vector x^(fc + 1) 
and any initial condition Xi(fc), due to the full rank condition on An (Assumption 1), one can promptly invert the 
system (Rl) and obtain the (finite) control vector u,(fc). To see this, consider the dynamical system (Rl) and suppose 
that Xi(fc + 1) and any initial condition x^(fc) are given. Then the control input Ui(k) can be determined as 

which, is finite by Assumption 1 and bu € Rq. 



4-3 Optimization Problem 



IMt + IJ-xjCt + IJH > 

I Mr) -Xj(r)\\ - \\AuVi(T) 



A ljVj (T)\\>0 (21) 



where the triangle inequality is used. Since ||xi(t) — 
x j( T )ll > \fPi the worst case scenario can be com- 
puted maximizing the term ||A]i?;j(T) — AijW,-(t)|| over 
Vi(r) G T v ^ and Vj(r) G J„j. This can be rewrit- 
ten as a non-convex QP problem and pre-solved off- 
line for any pair i and jGj If y/pi denotes the worst 
case ||AijWi(r) — AijU,-(r)|| over all the pairs, then the 
collision- free condition (21) can be expressed as p\ > p\. 
This is a condition that has to be imposed when de- 
signing the pi value in the minimal distance constraint 
0,2.1- In this respect, we note that the calculations per- 
formed to compute p\ can be made off-line before run- 
ning the optimization algorithm (and therefore even the 
non-convex nature of the problem given the small-size 
and the off-line calculations can be handled in a satis- 
factory way in practice) . 



1 In order to see this, consider the maximizing of | (r) — 

AijVj (t)\\. This is equivalent to maximize the squared norm 
ll-AiiUi(T) — AijU^r)!! 2 , which is equivalent to the following 
non-convex quadratic program 



Vi(r) \ I A[ X A U -AJiAij 
Vj{r) J y —AjjAu AjjAii 
subject to Vi(r) G T v ,i, Vj(r) G T v .j 



max 




The optimization problem (13) for the maximization of 
the algebraic connectivity can now be extended for the 
more general dynamics (14) as 



AP (AL(x),x(k),S AQ2 ) 
s.t. 



max 7(fc + 1) 

t(fe+l),u(fe), 7 (fc+l) 



(22) 



AQi 



AQ 2 



7 (fe + 1) > 
AL{x(k + 1)) + l N ljv >- j{k + 1)I N 

Q2.1 : Af d (xi(k + l),Xj(k + l)) > pi, 

v(»,i) e£ 



0,2.2 
Q 2 .3 
I Q2.4 



Xi(fc + 1) e Ti, i = l,...,N 

Ui(k)eUi, i=l,...,N 

x 4 (fc + 1) = Vi(xi(k), ui(k)), i = 1, 



,N 



where, Saq 2 = {pi, {Mi, Mi, b u , Hi, fe»)»=i, ...,jv}. As 
a solution of (22) we find the optimal control inputs 
Uj(fc) = (ui(r) , iti(r + l) T ) T that drive the system (14) 
from Xj(fc) to Xj(fc + 1). We define the concept of feasible 
state as follows. 

Definition 1 A state x(k) is feasible if Xj(fe) G Ti,\/i, 
AL(x(k)) + l N lJ, >- 0, anddf^k) > pi V(i,j) G £. 

For the optimization problem (22), as in [14], we assume 
initial feasibility for the first time instance: 

Assumption 3 The initial state x(0) is a feasible state. 

The following theorem states formally the persistent fea- 
sibility property: 
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Theorem 1 If for any discrete time k, x(/c) is a feasible 
state according to Definition 1, then the problem (22) will 
be feasible for the discrete time k + 1. 

Proof. Consider Xj(fc + 1) = (xi(k) T ,Oj) T as the so- 
lution of the optimization (22) at time k + 1. This so- 
lution satisfies AQi, Q%i, and Q2.2- Moreover, since 
Xj(fe) € Ti by assumption, there exist control inputs 
Uj(fc) € for all the agents for which (xi(k) T , 0j) T = 
T>i(xi(k), u,-(fc)). Therefore the solution Xj(A: + 1) satis- 
fies Q2.3 and Q2.4 and thus the claim. □ 

Combining Theorem 1 with Assumption 3, it follows that 
the sequence of problems (22) is feasible for all k > 0. 
We note that persistent feasibility (Theorem 1) is a fun- 
damental property to guarantee that the overall opti- 
mization scheme remains feasible, while we show later 
(in the distributed case) that the sequence of solutions 
lead to a monotonic increase of the cost function. 

The reasons for the initial choices of k = r/2 and Ti 
should be clearer after Theorem 1. The fact that 
Xj(fc) € Ti guarantees that the solution Xj(fc + 1) = 
(xi(k) T , Oj) T is feasible in terms of admissible control 
action, which is a sufficient condition to guarantee that 
the optimization problem (22) is persistently feasible. 
The choice k = r/2 ensures that T% is always non-empty. 

5 Distributed Solution 

In this section we present our main contribution: a non- 
iterative and guaranteed feasible distributed solution to 
solve (22). We note that this is not a trivial task, since 
commonly used decomposition methods for optimiza- 
tion problems (if applicable, e.g. in [9]) typically require 
iterative solutions which may not be amenable to fast 
real-time implementations. 

Our solution depends on subproblems which each agent 
solves locally and whose size can be decided accord- 
ing to the available resources. This size is influenced by 
the notion of an enlarged neighborhood set, collecting 
all the agents whose data are available locally at each 
time step k. The proposed distributed solution is com- 
puted in two phases. The first step is to solve a local 
optimization problem that is a small-scale modified ver- 
sion of the centralized problem, in which the farthest 
agents (in terms of graph distance, i.e. minimum num- 
ber of connecting edges) are constrained to be station- 
ary, i.e. x,*(fc + 1) = (xi(k) T ,0j) T . This step is sim- 
ilar to a Jacobi-type optimization [1], where only cer- 
tain variables are updated at a time, but also differs 
in the modification of the local problems and their re- 
duced size. The second step is to share the proposed so- 
lutions within the enlarged neighborhood and combine 
them using an agent-dependent positive linear combina- 
tion. We note that this sharing/combining procedure is 
performed just once for each optimization step, making 




Fig. 2. Notation for the distributed solution in case the size 
of the enlarged neighborhood size for agent i is m — 2. The 
thick lines represent links between connected agents. 

the overall scheme non-iterative in contrast with com- 
monly used consensus algorithms. The key point in the 
proposed distributed solution is to jointly construct the 
feasible local problems with modified local constraints 
and the positive linear combination of the solutions to 
preserve feasibility of the global solution and a mono- 
tonically increasing cost function. 

The most important novelty of the proposed solution 
is the idea of modifying the local problems and design- 
ing the merging mechanism to ensure feasibility and 
improvement properties for the locally merged solu- 
tion with respect to the original centralized problem. 
This idea, as remarked in the Introduction, offers a 
complementary approach to standard subgradient al- 
gorithms [1], which can be thought of as being on the 
opposite side of the "communication-computation" 
trade-off spectrum. 

Let Ji denote the enlarged neighborhood of i consisting 
of all the agents whose state is known by agent i at 
each sampling time k (either through direct or indirect 
communication). We define this set in a recursive way: 
let N} be the standard, first-order neighborhood of i, 

i.e. Ml = A/^ + , then, the n^-size enlarged neighborhood 
of i for m > 1 is defined as 

Ji=M?= U AT 1 *" 1 (23) 

in other words, the collection of the (n, — l)-size en- 
larged neighborhoods of all j € A/^" i_ .The scalar m > 1 
implies bounds on the diameter of the communication 
graph constructed with the agents in Jl. The cardinal- 
ity of Ji is Ji. We call the set of agents belonging to dJi, 
the bordering agents of Ji defined as 

dJi = € Ji,j i AT 1 * -1 } (24) 

Denote the graph Laplacian associated with the commu- 
nication graph corresponding to the agents in Ji as L^ ni 
and the communication link set as £^ ni ■ Figure 2 pro- 
vides a graphical illustration of this notation for rij = 2. 
Define x j i and u j i as the stacked vectors collecting the 
states and the lifted control inputs for all the agents j 
belonging to the enlarged neighborhood of i, i.e. j £ Ji- 
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As a first step of the distributed solution, for each agent 
i, we consider local problems AP^ of the form: 



AP i (AL j , n4 (a: <7( ),x <7< (fc),5 A&i ) : 



(25) 



max 7j(fc + l) 

x J7i (fe+l),u Ji (fc), 7i (fc+l) 



S.t. 



Ad 



AQ 2l : < 



7i(fc + l) > 
ALi.n, {x Jt {k + 1)) + lj 4 lj. >- 7i (fc + l)7j 4 

Q2.1 : A/ d (xi(fe+ l),^(fc + 1)) > piy, 
V(t,j) G£;,„ 4 



Q2.2 
Q2.3 
I Q2.4 



xj(& + i) € Pi =Fj, j e Ji 
x j (k + i) = v i ( Xj (k) , uj (k) 



Q.i : Xj (fc + 1) = ( Xj (k) T ,Oj) T , for j € 9Ji 



Where 5 



AQ 2 



{ (Piij , Aj i , 6ij , Hj , hj) jeJi } and 
the notation T>j denotes a dynamical system of the same 
form as (16) but with the modified triplet {A\j , Aij , b\j ) . 
We will show later (Theorem 2) how to construct the 
modified state matrices and parameter set S A q 2 .. 

The optimal local decision variables (solution of APj) 
will be denoted as ji(k + 1), xj- 4 (fc + 1), and uj t (k) 
respectively. We call Xy(fe + 1) the state of agent j as 
computed by agent i and we use the same notation for 
\iij(k). We note that the optimal local decision variables 
xj- 4 (fc + 1) and uj ; (fc) are composed of Xjj (fc + 1) and 
Uij(k) for each j e Ji. We emphasize that the extra 
constraint Q3 is an important requirement to guarantee 
feasibility, as will be explained shortly in this section. We 
will also require T% — T% for all the agents as a sufficient 
condition of persistent feasibility. 

Consider the set of all agents p which have agent i inside 
their local problems AP p , i.e. i € J p , and denote by 
J* = {p\i G J p }. Since the enlarged neighborhood size 
rii could differ from agent to agent, J* ^ Ji. 

As a second step of the distributed solution, we construct 
the position update based on the previous solution x(fc) 
and a positive linear combination of the local position 
solutions x j i (k) as: 

Xi(k + 1) = Xi(k) + ^2 ctj6xji(k + l), i = l,...,N 

jej* 

(26) 

foraj > (recall that, since Xy (fc) = Xi(k),5xji(k+1) = 
Xji(k + 1) — Xj(fc)). Define 

and observe that oti is in general not equal to one. We 
require on < 1 due to the linearization procedure, in 



fact, bigger a, would question the validity of the Taylor 
expansions in the local problems. 

We prove the following lemma regarding the sum of local 
position solutions, which is instrumental for the subse- 
quent theorems. 

Lemma 1 For arbitrary vectors qij G R 3 where 
are neighbors (i.e. if £%j 7^ 0), and for any Sx P i(k + 
1), 5x P j(k + 1) part of the optimal solutions of the local 
problems AP p in (25), with p e J* and p e J* respec- 
tively, the following equality holds: 



qjj ( ^2 oe p Sx pi (k + 1) - a p Sx pj (k + 1) 

qjj J2 (Sxpi{k + l)-5x pj {k + l)) (27) 



Proof. The first term of the equality (27) can be divided 
into three parts: p e J* H Jf, p e J* A p £ J* , and 

p G J* Ap ^ J* . Since we are interested in the case when 
i and j are neighbors, we can make the key observations 
that: 

{p\p e J* a P £ J* } =► i e dJ P (28) 

{p\p e J* a P i J* } => j e dj p (29) 

Consider the first implication (28). If p G J*, then i 
and p are separated by at most n p links. Furthermore, if 
P ^ Jf , then j and p are separated by at least n p + 1 links . 
Since i and j are neighbors, it follows that the separation 
between i and p is exactly n p links and therefore i G dj p . 
The second implication (29) can be proven by similar 
arguments. The two implications (28)-(29) allow us to 
rewrite the first part of the equality (27) as: 

qJi ^2 ctp(Sx pt (k + 1) - Sx p j(k + 1))+ 

Qij ^2 a P 8x p i{k + 1) -qjj ^2 a p 8xpj(k + l) 
P ej*Ap<£j* 



where the last two terms are due to (28)- (29) and the 
constraint Q3 of AP p in (25), which requires 5x p i(k + 
1) = and Sx P j(k + 1) = for i G dj p and j G dj p , 
respectively. □ 

We are ready to construct the parameter set 5 A g 2 . which 
defines the local set of constraints AQ 2! - 

Theorem 2 (Local constraints for global feasibility) 
Taking for eachi, the following choices: 
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• the local parameter set AQ 2i in (25) as 

5 aq 2i = {(Puj,aJ 1 A lj ,A 2j ,a j b lj ,H j ,aJ 1 h j ) jeJi } 

meaning: A\j = aJ 1 A\j,A2j = A2j,b\j — c\jb\j, 
Hj = Hj,hj =aj hj, and 

Pu j =aT j 1 (p 1 + 4(fc)(a tf -l)) (30) 

withaij = T, pe j*nj* °W 

• the positive linear combination of the local optimal con- 
trol inputs Uji(fc) in (25) as 

• i/ie positive linear combination of the local optimal ve- 
locities Vji(k + 1) in (25) as 

«i(fe + l)= _ (32) 

a, 

ensure that the updated position vector x(k + 1), i/ie con- 
fro/ uec£oru(fc), and velocity vector v(k+l) basedon (26), 
(31), and (32) respectively, satisfy the set of constraints 
AQ 2 of the global problem (22). 

Proof. We give a constructive proof of the theorem in 
Appendix B. 

Theorem 2 not only gives a procedure to construct the 
local constraints so that the linear combination (26) sat- 
isfies the global constraints, it also establishes a link 
between the local quantities and the global ones. Fur- 
thermore, it ensures that in order to move to the up- 
dated state Xj(fc+ 1) (comprised of the position update 
Xi(k + 1) and the velocity update Vi(k + 1)) each agent 
can implement the linear combination of the lifted con- 
trol input (31) as summarized in Algorithm 1, without 
explicitly computing the merging (26) or (32). In this 
context, from a control perspective, each local optimiza- 
tion problem (25) computes the control input uj^k). 
This is merged via (31) with the enlarged neighborhood 
information and then implemented. This merged control 
by Theorem 2 induces the merging mechanisms on the 
state (26) and (32), which therefore do not have to be 
computed explicitly. 

6 Properties of the Distributed Solution 

In the previous section we have seen how to construct 
the local problem parameter set S&q and positive lin- 
ear combinations of the local solutions to ensure that 
the combined solution (x(fc + 1), u(fc)) satisfies the con- 
straint AQ2 of the global problem (13). In this section 



Algorithm 1 Distributed A2 Maximization. 

1. Input for each agent i: Xj(fc), j € Ji 

2. Solve: APi in (23) computing 

(kji(k + l),u ji (k+ 1)), j e Ji 

3. Communicate: iiji(k + 1) among members of Ji 

4. Positive linear combination: 

5. Implement the control action u»(fc) 



we will look at AQi and at the persistent feasibility of 
Algorithm 1. Theorem 3 and 4 will establish that 

(CI) The algebraic connectivity of the global lin- 
earized Laplacian AL(x(k + 1)) of (13) with x(k + 1) 
computed via (26) is monotonically increasing in each 
iteration, which implies that x(k + 1) will also satisfy 
AQi of the global problem (13) for a certain value of 
7(fc + l) >7(fc). 

This is proven linking the linear combination (26) and 
the algebraic connectivity through the linear dependence 
of the linearized Laplacian on the position x. Theorem 5 
will show that 

(C2) The distributed optimization in Algorithm 1 is 
persistently feasible using the constructed AQ 2l ! s in 
Theorem 2. 

This is proven by the use of the relation between local 
and global feasibility of Theorem 2. 

First of all, reconsider the linearized Laplacian AL(x(k+ 
1)) entries, given in (??). We can rewrite AL(x(k + 1)) 
as a sum 

AL(x{k + 1)) = AL(5x(k + 1)) + L(x(k)). 

Under the validity of the employed Taylor approxima- 
tion, we assume that for all practical situations the value 
of L(x(k)) is equivalent to its linearized approximation 
AL(x(k)), and therefore we can write 

AL(x(k+l)) = AL(5x(k+l))+AL(x(k)) = L(x(k+1)). 

(33) 

Consider the local problem AP 4 in (25), and its solution 
comprised of Xij(k + 1) for all j e Ji. Construct the 
global vector x^(k + 1) whose entries are determined 
based on the local solution as 

+ 1) = (..., xf(k + l) T ,...) T , j = l,...,N 

with*«(* + l)=(*« ( * + 1) [ij€Ji (34) 
[ Xj(k) otherwise 
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where we keep those agent positions that have not been 
optimized fixed, and we update the rest from the solution 
of the local problem. 

Theorem 3 (CI. a) The positions x^(k + 1) in (34) 
constructed from the solution of the local problem APi 
in (25), monotonically increase the algebraic connectivity 
of the Laplacian matrix: 

AL(jgW(jfe + l)) h AL(x(k)). (35) 



Proof. Since AL depends linearly on the position x 
by (33) we can write 

AL(x^(k + 1)) = AL(5x^(k + 1)) + AL(x(k)), 

thus the relation (35) can be interpreted as 

AL(6x^(k + l)) h 0. (36) 



We recall that, 

First: for (34) 5xf {k + 1) = if j £ J t . 

Second: for the constraint Q 3 in the local problem 
AP, (25), 5xf{k + 1) = if j e dJi. 

For these two observations, [AL(Sx^ (k + ^ 

only if (i, j) e £i iTli and therefore up to a reodering the 
Laplacian AL{5x^ l \k + 1)) has the form 



AL w (dx Jt (k + l)) 












h 0. (37) 



We recall that xj i [k + 1) is the optimal decision variable 
for the position in the local optimization problems (and 
the order of the single elements is not important). 

We can now restate (36) via (37) as 



Lemma 2 When considering the positions x^\k + 1) 
in (34) andxi(k + 1) in (26) the following equality holds: 

N 

AL{Sx(k + 1)) = J2 OiAL(5i« (k + 1)) (38) 

i=l 

Proof. Let us consider the entry of the Laplacian 
AL on both sides of the expression. For the right side, 
ilf t can be expressed as 

tif* = <% T E a p (5x pi (k+l)-6x pj (k + l)) 

since the entry will exist only for the subproblcms 
AP p with pe J* D J* . For the left side, 

4f = ctj T {Sxi(k + 1) - Sxj{k + 1)) = 

c™ T E a p (5xpi(A; + 1) - ^ a p 5x pj (k + 1) 

The coefficient cfj T is non-zero only if (i, j) are neighbors 
and using Lemma 1 leads to 

4f = c£ T E ap(**i»(* + l)-^pj(fc + l)) D 

Using Theorem 3 and Lemma 2 we can now prove the 
monotonically increasing property of the algebraic con- 
nectivity of the global linearized Laplacian AL(x(k+l)). 

Theorem 4 (Cl.b) The algebraic connectivity of the 
global linearized Laplacian AL(x(k+l)) is monotonically 
increasing in each iteration, meaning AL(x(k + 1)) y 
AL(x(kj), where x(k + 1) is computed by the combina- 
tion (26). 

Proof. Theorem 3 implies AL(8x^ (k + 1)) y for all i. 
Thus summing over all agents leads to 

N 

Y,aiAL(5x^(k + l)) h0 
i=i 



ALi, nt {5x Jt (k + l)) h 

or 

AL W (x Jt {k + l))h AL i>ni (x 3% (k)) 

which is true due to the local optimality of the local 
solution of APi. □ 

We can relate the positions x^\k + l) in (34) with Xi(k + 
1) in (26), by the following Lemma. 



Considering the linear combination Xi(k + 1) in (26), 
and the associated global vector x(k + 1), by Lemma 2 
it follows that AL(Sx(k + 1)) y 0. From the linear de- 
pendence of AL on x (Equation (33)), 

AL(x(k + 1)) = AL(Sx(k + 1)) + AL(x(k)) 

and therefore it follows that AL(x(k + 1)) - AL(x(k)) y 
and the desired property: AL(x(k + 1)) y AL{x(k)). 
□ 
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Finally, we can show the persistent feasibility of the dis- 
tributed optimization algorithm (Algorithm 1). 

Theorem 5 (C2) The distributed optimization algo- 
rithm presented in Algorithm 1 is persistently feasible. 

Proof. We have to prove that if, for any discrete time k, 
x(fc) is a feasible initial state for the global optimization 
problem AP (22) at the discrete time k (Definition 1), 
then there will be a feasible solution to the distributed 
optimization problem in Algorithm 1. Such a feasible so- 
lution can be thought of as an initial state x(fc + 1) for 
the global optimization problem AP (22) at the discrete 
time k + 1. We prove the existence of such feasible solu- 
tion in two steps. 

Step 1. Using the assumption that x(/c) is a feasible ini- 
tial state for the global optimization problem AP (22) 
at time step k, we can show that x(/c) is also a feasi- 
ble initial state for the local problems AP; (25), which 
therefore are feasible and deliver local solutions (x j ( (k + 
l^uj^fc + 1)) satisfying the constraints AQi, AQ2i, 
and Q3. This claim follows from Theorem 2, in partic- 
ular from the fact that puj < p\. In fact, from the as- 
sumption a < 1 and dfj(k) > p\ (feasibility at k), the 
relation (30) yields puj < pi, and thus x(fc) is also a 
feasible initial state for the local problems AP; (25). 
Step 2. We can show that after merging/combining the 
resulting local solutions (xj^ (k + 1), uj t (k + 1)), the fi- 
nal distributed state solution x(/c + 1) will be a feasi- 
ble initial state for the global optimization problem AP 
in (22) at the discrete time k+1. This second step fol- 
lows directly from Theorem 2 and Theorem 4. □ 

Similarly to Theorems 2 and 4, we note that Theorem 5 
holds also if the agents change the size of their enlarged 
neighborhood rii from time step k to k + 1, since the 
feasibility of the state in the local problems does not 
depend on the enlarged neighborhood size of J7i. This 
fact will be used in the next section to allow adjusting the 
communication load of each agent and make Algorithm 1 
adaptive. 

7 Adapting the Communication Load 

In this section we investigate further the properties of 
the distributed solution presented in Section 5. First we 
show in Theorem 6 that if all-to-all communication is 
allowed then the distributed solution of Algorithm 1 is 
equivalent to the centralized approach in (22). Then 
we prove in Theorem 7 that starting from the same state 
vector x(fc) , if we run Algorithm 1 with different enlarged 
neighborhood sizes, the solution that delivers a higher 
algebraic connectivity at time step k + 1 is the one with 
the greater neighborhood size n. This last fact enables us 



2 Meaning that the two solutions (centralized and dis- 
tributed) are the same. 



to characterize a local relative sub-optimality measure 
with respect to a larger enlarged neighborhood size. 

Theorem 6 (Equivalence) The distributed solution of 
Algorithm 1 is equivalent to the centralized one of (22), 
if all-to-all communication is allowed (meaning ni = N, 
Vi, and thus no bordering agents) and if on — 1/N , Vi, 
is chosen as weight in the positive linear combinations of 
the local states and inputs (26), (32), and (31). 

Proof. Consider n; = N , dJi — {0} for all the agents, 
and the choice a; = 1/N, Vi. We have on = 1 and 
J2 p ej*nj* a p = 1- Therefore, as a consequence of the 

choices of Theorem 2, AQ2i = AQ2- Furthermore, all 
the constructed local solutions x^ (fc + 1) in (34) are the 
same and they are equivalent to the solution of the cen- 
tralized problem x(k + 1) in (22). Given the specified se- 
lection of oti, also the linear combination (26) is equiva- 
lent to x^ (k) and therefore the distributed position so- 
lution delivered by Algorithm 1 is equivalent to the cen- 
tralized one of (22). Since the same arguments hold for 
the control inputs and velocities the claim is proven. □ 

Definition 2 The vector x^'(k+l)\ is the con- 

structed local solution (34) using an enlarged neighbor- 
hood size rii in the local problem AP; (25). 

Definition 3 The vector x{k + l)| n is the global solu- 
tion of Algorithm 1 at step k + 1, with n = (711, . . . , njv). 

Using the above definitions, we can prove the following 
theorem about the effect of an increased neighborhood 
size on the resulting algebraic connectivity. 

Theorem 7 // ni > n2 element-wise, then the al- 
gebraic connectivity of AL (x(k + l)| n2 ) is greater 
than equal to the one of AL (ir(fc + l)| n ), implying 
AL(x(k + l)\ n2 )hAL(x(k + l)\ ni ). 

Proof. By optimality and due to the linearity of L on x 
(Eq. (33)), for each i we can state 

AL ^x w (fc + l)| J y AL ^Sx^\k + l)j ) 

Multiplying by and summing over i leads to 

Y'mAL ( 8x {l) (k+ 1)1 \ y 

^ OLiAL (sx^\k + 1)| \ 

By Lemma 2 the claim follows. □ 

We note that Theorem 7 holds considering one step hori- 
zon, i.e., from k to k + 1. Due to the non- linear/non- 
convex nature of the original problem (6), this result 
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does not hold in general from k to k + 2 or beyond, as 
we will show in the simulation experiments of Section 8. 

Theorem 7 is instrumental to construct a measure that 
can be used to decide locally on-line whether to increase 
or decrease the size rii of the enlarged neighborhood. 
This measure can be used to adapt rn to influence the 
trade-off between the increase of the algebraic connec- 
tivity or the reduction of the communication cost. For 
this purpose, we define two local relative sub-optimality 
measures with respect to a larger enlarged neighborhood 
size as 



A 2 (AL w+1 (xW(fc + l)| nt )) 



A 2 (AL iin(+ i(a;W(fc + l) 



m+i 



)) 



= 1 - 



X 2 (AL l ^(xM(k + l)\ ni _ 1 )) 
A 2 (AL w (xW(fc + l)L )) 



which determine the sub-optimality of the local solu- 
tions (34) with rii + 1 and rij — 1 with respect to the one 
obtained with rij. In particular, e\ measures the gain, 
in terms of local algebraic connectivity, one would have 
by increasing the enlarged neighborhood size from m to 
n, + 1, while e~ measures the loss of local algebraic con- 
nectivity going from n, to m — 1. (We note that both ef 
and e~ are non-negative due to Theorem 7) . 

Given specific lower/upper thresholds for e+ and e~ the 
agents can decide locally to increase or decrease rn at 
the successive time step k, trading off larger communica- 
tion efforts (for larger m) to smaller local algebraic con- 
nectivity increases (for smaller rii), making Algorithm 1 
adaptive. We note that although these sub-optimality 
measures are local, changing m locally by each agent has 
an effect on the global solution as illustrated by the re- 
lation (38) in Lemma 2. We note also that in order to 
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Fig. 3. Polytopic constraint for m. The shaded region repre- 
sents the set Ui C R 2 . 




Fig. 4. Centralized solution: the initial positions are marked 
with black dots. The final positions are marked with circles. 
The bold lines represent the final communication graph and 
the thin lines the agent trajectories. 

(due to the sequential convex programming approach). 
We consider the triples (An, A 2 i, bu) to be all equal 
to (I 2 T s /2,0.75I 2 ,I 2 T s /2) with T s = 1 (modeling a 
discrete-time double integrator dynamics) , while all the 
Mi's are constrained in the polytopic region of Figure 3. 
The other simulation parameters include the weighting 
function of Figure 1, p\ = 0.75, p 2 = 3 and final time 
T = 300. We performed and analyzed a total of 50 
simulation runs. 

In Figures 4-5, an example of the trajectories using the 
centralized and the distributed solutions are depicted. 
In the adaptive case, we start with rii = 2 for all agents 
and at every 5 discrete time step k we compute the sub- 
optimality measures. If the gain in increasing the en- 



compute e+ and eT" it is necessary to solve three opti- lar S ed neighborhood size is high enough, i.e., ej > 0.05, 
mization problems of the kind (25) for each i. Since this increase m, while if this gain is not high enough, i.e., 
can be computationally expensive, the agents can decide e i < 0-05, an d the losses in decreasing the neighbor- 
to determine e+ and e~ only once in a given number of hood size are not too big, i.e., e~ < 0.01, we decrease rii 
discrete time steps. to reduce the communication and computation costs. 



8 Numerical Results 

In this section, we present numerical simulation results 
to illustrate how the proposed distributed algorithm 
performs with respect to the centralized scheme. We 
use a benchmark problem motivated by [14]. Our sce- 
nario considers N = 10 agents moving on a 2D plane 
initially placed close to the horizontal axis and form- 
ing a connected graph. The initial position vector is 

Xi(0) = [— 6.75 + 1.5(i — 1), yi] T , where yt is drawn 
from a Gaussian distribution, with mean and stan- 
dard deviation a = 0.1. Randomness is added to test 
the algorithm's sensitivity to different initial conditions 



Figure 6 shows, in the same simulation, the algebraic 
connectivity as a function of the sampling time k, and 
clearly illustrates the nonlinear/non-convex nature of 
the problem. In fact, in this case, although the dis- 
tributed approximations are slower to converge than the 
centralized solution, in the end they achieve a slightly 
better final A 2 . 

Table 1 shows the ratio between the final connectivity of 
the distributed solution and the centralized one in the 50 
simulation runs. For better comparison, we report that in 
the adaptive case n, = 2.2 on average, with a maximum 
of rii = 5. We can observe that different choices of the 
local neighborhood sizes rii affect the final achieved X 2 . 
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Fig. 5. Simulation results of the distributed approach for various local neighborhood sizes rii (same Vi except in the adaptive 
case). The initial positions are marked with black dots. The final positions are marked with circles. The bold lines represent 
the final communication graph and the thin lines the agent trajectories. In the adaptive case, we start with rii = 2 Vi and at 
every 5 discrete time step k we compute ef and e~ . If ef > 0.05 we increase m, if e+ < 0.05 and e~ < 0.01 we decrease m. 




Discrete time instant k in log scale 



Fig. 6. Algebraic connectivity as a function of time k for 
both the centralized and the distributed solutions. 

Table 1 

Ratio between the final connectivity of the distributed solu- 
tion and the centralized one. The adaptive case is indicated 
with Hi(O). The cases N = {20,40} correspond to a random 
feasible initial configuration (not necessarily a line). 
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In particular, for the choice m = 1, the agents perform 
significantly worse than for other rij. Furthermore, using 
the adaptive case, the final A2 is comparable with the 
centralized solution in most of the simulations (or even 
better). This is an important point, since the adaptive 
case use an enlarged neighborhood size of n, = 2.2 (on 
average) and still obtains performances close or better 
than the fixed choice n, = 3. 

To further assess the proposed distributed algorithm, we 
include in Table 1 simulation results for N = {20, 40} 
robots starting from a feasible random configuration 
(not necessarily on a line) and using the adaptive algo- 
rithm with Uj(0) = 2. Each of these cases has been run 
50 times. We can observe that both in the N = 20 case 
(where the average rii is 2.7) and in the N = 40 case 
(average rii — 2.6), the results are in line with the con- 
clusions that could be drawn for the case of N = 10. 
From these results one could conjecture both the scala- 
bility of Algorithm 1 (for the adaptive case) and its in- 
creased performances dealing with large systems. In par- 
ticular, while the number of agents passes from N = 10 
to N — 40, the averaged size of the enlarged neighbor- 
hood stays rather the same (and also the performance 
in term of final A2). This means that the computational 
and communication efforts for the single agent stay the 
same. Thus, the gain of the distributed solution with re- 
spect of the centralized solution, in terms of computa- 
tions and communications, increases. 

9 Conclusions 

We have presented a distributed solution to the maxi- 
mization of the algebraic connectivity of the communi- 
cation graph in a robotic network. Our characterization 
can handle more generic LTI agent dynamics than the 
methods available in the literature and the resulting op- 



13 



timization problem is proven to be feasible at each time 
step under reasonable assumptions. Furthermore the so- 
lution can be adjusted based on available resources using 
local relative sub-optimality measures to aid in adapting 
the neighborhood size to the agents' needs. 

Simulation results confirm the efficacy of our distributed 
approach and show its practical applicability. Some open 
issues still remain and will be the focus of our future 
research. In particular, robustness of the proposed algo- 
rithm against estimation errors is currently being inves- 
tigated. The applicability of the distributed scheme in 
a broader class of problem formulations involving LMI 
constraints is part of our research plans, as well as ex- 
perimental validations. 
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A Generalization to LTI systems 

This appendix considers the issues related to the use of 
more general systems than (14) in the centralized prob- 
lem (22). We start from a generalization of (14) consid- 
ering the (M + 2)-order system: 



( Xi(T+l) \ 
Vi(T+l) 

yu(r + l) 
\ynn(T + i)/ 



I I s * * 
O3 * * 
3 * * 



\ 



/ 



/ Xi{T) \ 

Vi(r) 
Vu(r) 

\vMi(r)J 



( 03 \ 



Ui(r) 



\biih J 



where the stars represent non-zero elements and bu <G 
Ro. It is not difficult to see that Algorithm 1 is also 
applicable to these types of systems, under quite general 
assumptions and minor modifications. The key idea is 
to compute the control actions every M + 2 steps while 
the crucial drawback is that the larger M + 2 is, the 
more p\ has to be shrunk to accommodate the collision 
avoidance requirement (see condition (21) which has to 
be generalized in this case in a straightforward manner). 

Consider now the generic LTI system 

Xj(r + 1) = AjXj(r) + BjUi(r) 

where the couple (Aj, Bi) is controllable and where the 
state can be partitioned as (xi(r) T , £i(r) T ) T . In order 
to apply Algorithm 1, we need to characterize a modifi- 
cation of the set Ti which is defined as: 

x;(t) G 3{w;(t),. . . ,u;(t + T-1)} G W; such that 

T-l 

Afx i (r) + ^ Aj-^Biuir+h) = (a; l (r) T , 0) T , Vr G N+ 



By computing Tj ', we can extend Algorithm 1 also to 
general LTI systems, calculating the control every T time 
steps. However, several issues have to be addressed: (i) 
the parameter T is agent-dependent and it depends on 
r, making the determination of a single Tj quite com- 
plex; (ii) the set Tj depends also on the position Xi(r) 
restricting the area in which the agents can move; (Hi) 
since T can be in general quite large, the condition on 
pi could be rather limiting and it could conflict with the 
requirements on Tj . 



B Proof of Theorem 2 

At optimality the local constraints for the subproblcm 
AP p in (25) are the following: 

Mp g X n Jj ■ 

Q2.1 : A/ d (a; i (A; + l),a; J -(A; + l)) = 



dij(k) + [ij] T (5x pi {k + 1) - Sx p j(k + 1)) > puj, 



vpb e j: 



Q2.2 
Q2.3 

Q2.4 



x pi (k + 1) € Ti = Ti 
iipi(k) G Ui 
it P i(k + 1) = 2?i(xi(fc),u p i(fc)) 



(B.la) 



(B.lb) 
(B.lc) 
(B.ld) 



The theorem claims that using the specified choice for 
S A q 2 > if w e combine the local optimal solutions (i p i(k + 
l),u p i(fc)) which satisfy the local constraints (B.l), us- 
ing the positive linear combinations (26), (31), and (32) 
we will obtain a couple (x(fc + 1), u(fc)) that satisfies the 
constraint AQ 2 of the global problem (22). This is what 
we need to prove. 

Consider Q 2 .i in (B.la) and the positive linear combi- 
nation for x(k + 1) in (26). By Lemma 1 follows: 

d%{k) + [ij] T {8xi{k + 1) -S Xj (k+ 1)) = 
= dij(k) + [ij] T a p (8x p i(k + 1) - 8x pj (k + 1)) > 



(1 - aij)d i:j {k) + (B.2) 



For x(k + 1) it is required the satisfaction of the global 
constraint: 

dij(k) + [ij] T (5xi(k + l)-5xj{k + l)) > pi (B.3) 

which can be accomplished by selecting puj such that: 

(1 - aij)d?-(fc) + ctijPiij = pi (B.4) 

This gives the formula for puj in (30). 

Consider the constraints Q 2 .4 m (B.ld) on the agents' 
dynamics. For the positive linear combination (26) the 
combined system dynamics becomes 



Xi(k+1) 

E a P v P i(k + l) j i„ _ ( { , 



I 3 onAu{h +A 2i ) 
2 

2i 



Xi(k) 
Viik) 



, U , l1 . 3 ] ^2 a pUpi(k) (B.5) 



Since the agents have to move according to the dynam- 
ical system (16) encoded in the global constraint Q2.4 
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of (22), the update (B.5) and the state equation (16) 
have to be the same. It is not difficult to see that this 
is ensured by the choice An — a^ 1 Au, An = An, 

bu = etibu, and the linear combinations (31) and (32) 
for the local control inputs u p i(k) and local velocities 
Vpi(k + 1). 

From the linear combination on the control (31) and the 
global constraint Q2.3 in (22) follows the specification 
for the local constraint Q2.3 in (25): 

U % = {u pl (k) e M. 3 \H t u pl < 6V 1 hi} (B.6) 

from which (Hi, hi) = (Hi, a" 1 ^). We recall that the 
positive linear combination on the control input (31) has 
been constructed in a way to steer the system (16) from 
the position x(k) to the updated position x(k + l) in (26) 
while respecting the global constraints Q2.3 in (22). 

Consider now Q 2 .2 in (25). We need to prove that if the 
local optimal states x p i(k+l) belong to the set Pi in (25), 
then the updated state Xj(fc + 1) constructed via the 
linear combinations on position (26) and velocity (32) 
belongs to the set Ti as expressed in the global constraint 
Q2.2 in (22). First of all, it is straightforward to see that 
the local inequalities 



H i b^ 1 (h + A 2i ) 
Hib^ 1 A 2i (I 3 + 2A 2i 



v pl (k + l) < / (B.7) 



are equivalent to the inequalities (20), meaning that by 
construction J"j = Ti. Recall that the set T% does not 
constrain the position. Since the updated velocity Vi(k + 
1) in (32) is obtained by a positive linear combination 
of local v P i(k + 1) then also Vi(k + 1) will satisfy the 
inequalities (B.7), and therefore the updated state Xi(k+ 
1) belongs to Ti. 

Having ensured that with the choices of Theorem 2 the 
positive linear combinations of the local solutions satisfy 
the constraints Q2.1 — Q2.4 of (22), Theorem 2 is proven. 
□ 
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